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Abstract 


This paper investigates the application of a neural network-based model reference 
adaptive intelligent controller for controlling the nonlinear systems. The idea is to 
control the plant by minimizing the tracking error between the desired reference 
model and the nonlinear system using conventional model reference adaptive con- 
troller by estimating the adaptation law using a multilayer backpropagation neural 
network. In the conventional model reference adaptive controller block, the con- 
troller is designed to realize the plant output converges to reference model output 
based on the plant, which is linear. This controller is effective for controlling the 
linear plant with unknown parameters. However, controlling of a nonlinear system 
using MRAC in real-time is difficult. The Neural Network is used to compensate the 
nonlinearity and disturbance of the nonlinear pendulum that is not taken into con- 
sideration in the conventional MRAC therefore, the proposed paper can signifi- 
cantly improve the system behaviour and force the system to behave the reference 
model and reduce the error between the model and the plant output. Adaptive law 
using Lyapunov stability criteria for updating the controller parameters online has 
been formulated. The behaviour of the proposed control scheme is verified by de- 
veloping the simulation results for a simple pendulum. It is shown that the pro- 
posed neural network-based Direct MRAC has small rising time, steady-state error 
and settling time for a different disturbance than Conventional Direct MRAC adap- 
tive control. 
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Model reference adaptive control (MRAC), Neural Network (NN), Multilayer Back 
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1. Introduction 


In the adaptive control, controlling of the nonlinear system with present-day sophistication and complexities has often been an 
important research area due to the difficulty in modelling, nonlinearities, and uncertainties. Model reference adaptive control 
is the best scheme used in the adaptive control technique. Recently MRAC has received considerable attention and many new 
approaches have been applied to the practical process [2]. In the MRAC scheme, the controller is designed to realize the plant 
output converges to reference model output based on assumption that plant can be linearized [3], [4], and [5]. Therefore, di- 
rect MRAC is best controller for controlling linear plants with unknown parameters. However, it may not guarantee for control- 
ling nonlinear plants (Pendulum) with unknown structure. In recent years, an artificial neural network (ANN) has become very 
popular in many control applications due to their higher computation rate and ability to handle nonlinear systems [6]. 

The adaptive controller is designed to realize a plant output tracks to reference model output based on assumption that 
the plant can be linearized. [8], [9], [3] However, as most industrial processes are highly nonlinear, non-minimum, and with 
various type of uncertainties and load disturbances the performance of the linear MRAC may deteriorate, and suitable non- 
linear control may have to be used. 

In [11], the output of neural networks then adaptively adjusts the gain of the sliding mode controller so that the effects of 
system uncertainties eliminated and the output tracking error between the plant output and the desired reference signal can 
be asymptotically converging to zero. However, the sliding mode control action can lead to high frequency oscillations called 
chattering which may excite un-modeled dynamics, energy loss, and system instability and sometimes it may lead to plant 


damage. 
2. Mathematical Modeling 


Consider the simple pendulum shown in Figure 1, where | denotes the length of the rod and m denotes the mass of the bob. 
Assume the rod is rigid and has zero mass. Let 8 denote the angle subtended by the rod and the vertical axis through the piv- 
ot point. The pendulum is free to swing in the vertical plane. The bob of the pendulum moves in a circle of radius |. To write 
the equation of motion of the pendulum, let us identify the forces acting on the bob. There is a downward gravitational force 
equal to mg, where g is acceleration due to gravity. There is also a frictional force resisting the motion (by air and any other 


frictions), which we assume to be proportional to the speed of the bob with a coefficient of friction b. 
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Figure 1 Simple pendulum modeling 


x = lsin@,h = l(1 — cos@) (2.1) 
1 1 22 
K.E =>1w* = >mv* ee) 
a ge a2 2 (2.3) 
os. = ml*,v = Vy + Vy 
_dx  _dy 9 _ (dx\* 2 _ (ay)\* (2.4) 
Ve = ae Vy = Gp Ux =() vy = (2) 


Substituting equation (2.1) to equation (2.4) 


w= (#)" = = (l6cosé) Vy = (2) = (lsind)” 


(2.5) 
K.E = ~m(v3 + vy) = =m((l6cos6)° + (lOsin®) ) 
Therefore, 
K.E = =m ((16)° [cos? 6 + sin? 6) 
K.E = =m((16)"), since cos*@+sin?90=1 (2.6) 
P.E =mgh, but h = |(1 — cos@), P.E = mgl(1 — cos@) (2.7) 


By using Lagrangian equation 
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1 “2 
L=K.E-P.E= 5 m((16) — mgl(1 — cos@)) 


d (=) - OL (t = $i 
ara eye a9 7 orque 


ies 176, ia l(—sin@) = lsin@ 
aa a9 = mgl(—sin8) = —mglsin#, 
d (OL : 
a gill 
dt \d@ 


Therefore,ml?6 + mglsin@ + b@ = t(torque) 


The mathematical model for a simple pendulum is that 


ml?6 + mglsin@é + b@ = t(torque) 


The state space form of the pendulum is given by, 
Let x, =0,x%»=0=wW 


X41 = Ox, + Xo 
b 


X2 — 
ml 


—5 X2 +— 5 [t — mglsinx,| 


1 

ml? 

On the other hand the state space form is given by 
x4 = Ox, + X92 


X= 2 [t — mglsinx, — bx2| 


x = Ax + BA [u— 6" @(x)], A control input uncertainty 


3. Controller Design 


3.1. Adaptive control 


(2.8) 


(2.9) 


(2.10) 


(2.11) 


(242) 


(2.13) 


(2.14) 


Adaptive control is the best control method used by a controller, which must adapt to a controlled system with parameters, 


which vary or are initially uncertain [12], [16]. For example, as an aircraft flies, its mass will slowly decrease because of fuel 


consumption; a control law is needed that adapts itself to such changing conditions. 


3.1. 1 Model Reference Adaptive Control 


MRAC is one of adaptive control classification technique as shown in figure 2 below. When designing a controller for a sys- 


tem, a control designer typically would like to know how the system behaves physically. This knowledge is usually captured in 


the form of a mathematical model. 


There are generally two classes of adaptive control: direct adaptive control and indirect adaptive controller [1]. Direct 


adaptive controller methods adjust the control gains directly and indirect adaptive controller methods estimate unknown 


system parameters for use in the update of the control gains. Asymptotic tracking is the fundamental property of mod- 


el-reference adaptive control, which guarantees that the tracking error tends to approximately zero in the limit. 
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Reference model 
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Figure 2 Block diagram of typical MRAC 


3.2. Multilayer Neural Networks (Back propagation Algorithm) 

The input signals are propagated in a forward direction on a layer-by-layer basis. Learning in a multilayer network proceeds 
the same way as for a perception. In a back-propagation neural network, the learning algorithm has two phases. First, a 
training input pattern is presented to the network input layer [19]. The network propagates the input pattern from layer to 
layer until the output layer generates the output pattern as shown in figure 3 below. 

Second, if this pattern is different from the desired output, an error is calculated and then propagated backward through the 


network from the output layer to the input layer. The weights are modified as the error is propagated. 
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Figure 3 Back-propagation neural network 


3.2.1. The Back propagation training algorithm 
Back propagation is a common method for training a neural network, the goal of back propagation is to optimize the weights 
so that the neural network can learn how to correctly map arbitrary inputs to outputs. [19] 


Back propagation method contains the following steps: 
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Step 1: Initialization; set all the weights and threshold levels of the network to random numbers uniformly distributed inside 


a range: 


( 2.4 +=) (3.1) 
Fi’ Fi 

Where Fi is the total number of inputs of neuron t in the network. 

Step2: Activation; activate the back-propagation neural network by applying inputs x1(p),x2(p),... ,xn(p) and desired 

outputs Yqi(P),VYa2(P), +» »-Yan(P) (forward pass). 


Calculate the actual outputs of the neurons in the hidden layer: 


- (3.2) 
y;(p) = sigmoid ») x; (p). wij (Pp) — a 
t=1 
Where n is the number of inputs of neuron j in the hidden layer. 
Calculate the actual outputs of the neurons in the output layer: 
(3.3) 


Vx(p) = sigmoid » Xjx (P).Wix(p) — Ox 


Where m is the number of inputs of neuron k in the output layer 
Step 3: Weight training (back-propagate):-Update the weights in the back-propagation network propagating backward the 
errors associated with output neurons. 
Calculate the error gradient for the neurons in the output layer: 
6x (p) = xe). [1 — Ve (P)]- ex) (3.4) 
Where, ex (Pp) = Yax(P) — yx (p) 


Calculate the weight corrections: 


Aw;x(p) = a@. y;(p). 5% (p) (3.5) 
Update the weight at the output neurons: 
Wx (p + 1) = wix(p) + Aw; (p) (3.6) 


Calculate the error gradient for the neurons in the hidden layer 


(3.7) 
5,(P) = ¥P)-[1-y@)]- > be) Hel) 
k=1 
Calculate the weight corrections: 
Wij(p) = a.x;(p). 6;(p) (3.8) 
Update the weights at the hidden neurons: 
wij(p + 1) = wij (p) + Aw; (p) (3.9) 


Step 4: Iteration:-Increase iteration p by one, go back to Step 2 and repeat the process until the selected error criterion is 


satisfied. 
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3.4. Adaptation law design for simple pendulum 
From state space equation form of the simple pendulum in the equation shown below. 


X1 =— Ox, + X> (4.1) 


1 
= 0x + 7) [t — mglsinx, — bx, | 


We can express as a general expression of x = Ax + B A [u— 67@(x)] because the parameters of mgl and b are un- 
known or vary with time. Therefore, we can assign as the estimates of the parameter 0,(thetal1),0,(theta2) respectively 
and the known basis function sinx, and x2 to @,(X),@2(X) respectively. 

From the above 


X41 — Ox, + X> (4.2) 


a pi (x) 
=[t—[0,(thetal) 6 2(theta2)| heel 


Let the adaptive controller 
t= —K,.”.x+k,(t).r(t) + 67 (OH ep(x), (4.3) 
where, Ak, = k,(t) — k, ,A@ = 6 (t) —@ * 
However, K, is the ideal controller gains obtained from Linear Quadratic Regulator. 
Based on the Lyapunov adaptive law in chapter 3 we can get the estimates of 
Ak, = k, = y,re’ PsgnB 
Ad = 6 =Tgy(x)e’ PsgnB 
The dimension of theta and phi as shown 
2 [2] =[rg 000 =|] =P Jer = ta 


Where e€; =Xym — xX; and e€, =Xym — Xz and y,,Ig are adaptation rates. 


Table 1 Physical parameters of simple pendulum 


Parameters | Value | Unit 
m(pendulum mass) 


(length of the rod) to | mm 
b(damping coefficient) sith or kg/s 
g(gravity constant) 98 m/e 





Linearizing the nonlinear pendulum at equilibrium point (0,0) to design the reference model. 
Therefore, from table 1, we can determine the sate space parameters as shown below. 


X =AX+ BU 
Ax, -[° Wecl+ [Ou 
Ax, —9.8 a Ax, 


A 
Y=CX+DU ey=[10] i 


Ax, 
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The general block diagram for conventional direct model reference control in figure 4 below. 





Refrence model for simple pendulum 


Figure 4 MATLAB/SIMULINK model for Conventional MRAC for nonlinear pendulum. 


4. Simulation Results 


4.1. Conventional Direct Model Reference Adaptive control for nonlinear pendulum result 


The simulation result for conventional model reference adaptive control as shown below in figure 5 and figure 6. 


Comparision of CMRAC and Reference model for simple pendulum 
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x1 Plant C MRAC 
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Figure 5 Angle response for IP disturbed from 0.1rad using Conventional MRAC 
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Figure 6 Angle response for IP disturbed from 0.2rad using Conventional MRAC 


For a given stable equilibrium, Odeg input as reference the nonlinear system response tracks to the reference model after 
15.5 seconds. In figure 7 below response for the nonlinear system the tracking error is high at the beginning so to reduce the 


tracking error Artificial neural network is preferable. 


Nonkinear plant and reference model error for simple pendulum 





Angle error for Inverted pendulum in(rad) 


0 5 10 15 20 25 30 35 40 45 =H) 
Time (seconds) 


Figure 7 Angle Error between nonlinear plant and reference model to stable equilibrium point. 


The parameter adjustment for conventional direct model reference adaptive control for nonlinear inverted pendulum as 


shown in figure 8 below for 0.1rad disturbance. 
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Adaptive law parameter estimation 


Estimation of Nonlinear uncertanity to ideal values 





Time (seconds) 


Figure 8 Estimated adaptive law result for O0.1rad disturbance for nonlinear pendulum 


4.2. Neural network based direct MRAC for nonlinear pendulum result 


In this paper, Artificial NN is used to improve the performance of nonlinear system by training of adaptation law to improve 
the plant due to rapidly estimating of the nonlinear uncertainty and unknown parameters to ideal values. Now NN is dividing 
into three layers, named the input layer with 5 neurons, the hidden layer with 20 neurons, and the output layer with 3 neu- 
rons. Backpropagation learning algorithm (Levenberg - Marquardt) is used to train the network. The ANN training data sam- 
ples are collected from the input and output of Adaptation law. The hidden layer neurons are activated by using tan sigmoid- 
al activation function and output a pure linear activation function is used. 

The general block diagram for neural network based direct model reference adaptive control for nonlinear inverted pendu- 


lum shown in figure 9 below. 


Goto 







Refrence model for simple pendulum 


Nonlinear Plant for simple pendulum 


Function Fitting Neural Network 





Journal of Informatics Electrical and Electronics 
ISSN (Online): 2582-7006 10 Engineering (JIEEE) 
A2Z Journals SN Gamal 


\S 


A. Assefa 


Figure 9 MATLAB/SIMULINK model for nonlinear pendulum using NN-MRAC 


Conventional MRAC For different initial angle(Disturbance) 


Re Conventional Model reference adaptive control for simple pendulum 





Neural network based Model reference adaptive control for simple pendulum 


Neural network based MRAC For different initial angle(Disturbance) 


Figure 10 Comparison of both conventional MRAC and NN based MRAC for nonlinear pendulum 


Using NN based MRAC and Conventional MRAC design the simulation result from figure 10 above block diagram for the sim- 


ple pendulum system is illustrated in the figure (11-13) with different disturbances as shown. 


Comparision of CMRAC and NNMRAC for simple pendulum 


2.1 Model ra france 
21 Plant C MRAC 
21 Model re france 
21 Pilant NN MAAC 





Angle of Inverted pendulum injrad) 


oO 5 10 14 20 25 a a 40 45 50 
Time (seconds) 


Figure 11 Comparison of Conventional MRAC and NN-MRAC angle response for IP disturbed from O.1rad. 
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Comparision of CMRAC and NNMRAC for simple pendulum 
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Figure 12 Comparison of Conventional MRAC and NN-MRAC angle response for pendulum disturbed from 0.2rad. 


Comparision of angle error for simple pendulum 
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Figure 13 Comparison of angle error for pendulum given 0.2rad disturbance 


From the above the NN based direct model reference control is better performance based on time specification i.e. rise time, 
settling time and steady state error than conventional direct MRAC for different disturbance. Generally given Disturbance as 
pulse input as shown figure 14 below and see the result both Conventional MRAC and NN based direct MRAC in figure 


(15-17) and the parameter adjustment for different disturbance in figure 18 shown below. 
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Pulse input given to simple pendulum angle 
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Figure 14 Different disturbance given to the angle of pendulum. 
Comparision of CMRAC and NNMRAC for Inverted pendulum 
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Figure 15 Comparison of angle response for Different disturbance given to angle of pendulum 


Journal of Informatics Electrical and Electronics 


ISSN (Online): 2582-7006 13 Engi ing (JIEEE @ 
(Online) ngineering ( INA 


A2Z Journals 


A. Assefa 


Comparision of angle error for IP 


Angle Error far Invertad pandulum Using CMRAC 
=== Angie amor for inveared pandulum Using NNMRAC 
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Figure 16 Comparison of angle error for a different disturbance on the angle of pendulum. 
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Figure 17 Control signal for simple pendulum for the different disturbance. 
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Adaptive law parameter estimation 





Estimation of Nonlinear uncertanity to ideal values 


0 10 20 a0) 40 4} 60 fo BO oO 100 
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Figure 18 Estimated adaptive law result for different disturbance for pendulum 


Finally, we can observe from the above graphs an ANN controller is a powerful controller to stabilize a nonlinear simple pen- 
dulum system when compared to Conventional MRAC. The conventional MRAC and an artificial neural network controller are 


designed for the stabilization of simple pendulum systems. 


5. Conclusion 


In this paper, modeling and designing of neural network based direct MRAC of nonlinear systems using MATLAB software to 
overcome the tracking performance of conventional direct model reference adaptive control to an equilibrium point for dif- 
ferent disturbances have been investigated. Adaptive law using Lyapunov stability criteria for updating the controller param- 
eters online has been formulated. Both the transient and steady state performances of the nonlinear system are improved by 
updating the parameters of neural networks (weight and biases) controller. The effectiveness of the proposed NN based 
DMRAC and Conventional MRAC is tested using MATLAB/SIMULINK. It is observed from the simulation results that the pro- 
posed NN based Direct MRAC has 3.13sec rise time, 5.15sec settling time for 0.1rad disturbance and 3.12sec rise time, 
5.21sec settling time for 0.2rad disturbance. Whereas, the conventional direct MRAC has 5.42sec rise time, 15.5sec settling 
time for 0.1rad disturbance and 5.01sec rise time, 15.52sec settling time for 0.2rad disturbance. It is shown that the pro- 
posed neural network based Direct MRAC has smaller rising time, steady-state error and settling time for a different disturb- 


ance than Conventional DMRAC adaptive control. 
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